Pandas Profiling Report

Dataset statistics

Number of variables	20
Number of observations	338592
Missing cells	2716785
Missing cells (%)	40.1%
Duplicate rows	309474
Duplicate rows (%)	91.4%
Total size in memory	51.7 MiB
Average record size in memory	160.0 B

Variable types

Numeric	18
Categorical	2

Warnings

Dataset has 309474 (91.4%) duplicate rows	Duplicates
`PayFukusyoPay1` is highly correlated with `PayFukusyoUmaban5` and 1 other fields	High correlation
`PayFukusyoNinki1` is highly correlated with `PayFukusyoUmaban5` and 1 other fields	High correlation
`PayFukusyoUmaban2` is highly correlated with `PayFukusyoUmaban5` and 1 other fields	High correlation
`PayFukusyoPay2` is highly correlated with `PayFukusyoUmaban5` and 1 other fields	High correlation
`PayFukusyoNinki2` is highly correlated with `PayFukusyoUmaban5` and 1 other fields	High correlation
`PayFukusyoUmaban3` is highly correlated with `PayFukusyoUmaban5` and 1 other fields	High correlation
`PayFukusyoPay3` is highly correlated with `PayFukusyoUmaban5` and 1 other fields	High correlation
`PayFukusyoNinki3` is highly correlated with `PayFukusyoUmaban5` and 1 other fields	High correlation
`PayFukusyoUmaban4` is highly correlated with `PayFukusyoUmaban5` and 1 other fields	High correlation
`PayFukusyoPay4` is highly correlated with `PayFukusyoUmaban5` and 1 other fields	High correlation
`PayFukusyoNinki4` is highly correlated with `PayFukusyoUmaban5` and 1 other fields	High correlation
`PayFukusyoUmaban5` is highly correlated with `PayFukusyoPay1` and 15 other fields	High correlation
`PayFukusyoNinki5` is highly correlated with `PayFukusyoPay1` and 15 other fields	High correlation
`PayWakurenKumi1` is highly correlated with `PayFukusyoUmaban5` and 2 other fields	High correlation
`PayWakurenPay1` is highly correlated with `PayFukusyoUmaban5` and 1 other fields	High correlation
`PayWakurenNinki1` is highly correlated with `PayFukusyoUmaban5` and 1 other fields	High correlation
`PayWakurenPay2` is highly correlated with `PayWakurenNinki2`	High correlation
`PayWakurenNinki2` is highly correlated with `PayWakurenPay2`	High correlation
`PayUmarenKumi1` is highly correlated with `PayFukusyoUmaban5` and 2 other fields	High correlation
`PayFukusyoUmaban5` is highly correlated with `PayFukusyoNinki5`	High correlation
`PayFukusyoNinki5` is highly correlated with `PayFukusyoUmaban5`	High correlation
`PayFukusyoUmaban4` has 337672 (99.7%) missing values	Missing
`PayFukusyoPay4` has 337672 (99.7%) missing values	Missing
`PayFukusyoNinki4` has 337672 (99.7%) missing values	Missing
`PayFukusyoUmaban5` has 338561 (> 99.9%) missing values	Missing
`PayFukusyoNinki5` has 338561 (> 99.9%) missing values	Missing
`PayWakurenPay1` has 4958 (1.5%) missing values	Missing
`PayWakurenNinki1` has 4958 (1.5%) missing values	Missing
`PayWakurenKumi2` has 337965 (99.8%) missing values	Missing
`PayWakurenPay2` has 337965 (99.8%) missing values	Missing
`PayWakurenNinki2` has 337965 (99.8%) missing values	Missing
`PayWakurenKumi1` has 4958 (1.5%) zeros	Zeros

Reproduction

Analysis started	2021-04-07 12:55:50.540495
Analysis finished	2021-04-07 12:57:26.639600
Duration	1 minute and 36.1 seconds
Software version	pandas-profiling v2.11.0
Download configuration	config.yaml

PayFukusyoPay1
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	351
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	291.9809978
Minimum	100
Maximum	11030
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	100
5-th percentile	110
Q1	140
median	180
Q3	290
95-th percentile	800
Maximum	11030
Range	10930
Interquartile range (IQR)	150

Descriptive statistics

Standard deviation	400.493873
Coefficient of variation (CV)	1.371643621
Kurtosis	122.7952143
Mean	291.9809978
Median Absolute Deviation (MAD)	60
Skewness	8.540567827
Sum	98862430
Variance	160395.3423
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
110	40548	12.0%
140	22087	6.5%
150	21196	6.3%
130	20677	6.1%
160	18100	5.3%
120	17757	5.2%
170	15558	4.6%
180	14495	4.3%
190	13723	4.1%
200	11530	3.4%
Other values (341)	142921	42.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
100	2606	0.8%
110	40548	12.0%
120	17757	5.2%
130	20677	6.1%
140	22087	6.5%

Value	Count	Frequency (%)
11030	12	< 0.1%
10030	14	< 0.1%
10000	16	< 0.1%
8340	14	< 0.1%
8030	12	< 0.1%

PayFukusyoNinki1
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	18
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.505277738
Minimum	1
Maximum	18
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	3
Q3	5
95-th percentile	9
Maximum	18
Range	17
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	2.872211823
Coefficient of variation (CV)	0.8193963608
Kurtosis	1.987844545
Mean	3.505277738
Median Absolute Deviation (MAD)	2
Skewness	1.464734818
Sum	1186859
Variance	8.249600753
Monotocity	Not monotonic

Histogram with fixed size bins (bins=18)

Value	Count	Frequency (%)
1	105030	31.0%
2	63158	18.7%
3	43399	12.8%
4	34055	10.1%
5	23781	7.0%
6	18878	5.6%
7	14706	4.3%
8	10848	3.2%
9	7946	2.3%
10	5528	1.6%
Other values (8)	11263	3.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	105030	31.0%
2	63158	18.7%
3	43399	12.8%
4	34055	10.1%
5	23781	7.0%

Value	Count	Frequency (%)
18	49	< 0.1%
17	31	< 0.1%
16	394	0.1%
15	825	0.2%
14	1188	0.4%

PayFukusyoUmaban2
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	18
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	7.935444429
Minimum	1
Maximum	18
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	4
median	8
Q3	11
95-th percentile	15
Maximum	18
Range	17
Interquartile range (IQR)	7

Descriptive statistics

Standard deviation	4.455406002
Coefficient of variation (CV)	0.5614563926
Kurtosis	-1.016068041
Mean	7.935444429
Median Absolute Deviation (MAD)	4
Skewness	0.1835155081
Sum	2686878
Variance	19.85064265
Monotocity	Not monotonic

Histogram with fixed size bins (bins=18)

Value	Count	Frequency (%)
4	24362	7.2%
6	23758	7.0%
5	23652	7.0%
2	23586	7.0%
8	23538	7.0%
3	23437	6.9%
9	23039	6.8%
7	22788	6.7%
10	22715	6.7%
1	22263	6.6%
Other values (8)	105454	31.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	22263	6.6%
2	23586	7.0%
3	23437	6.9%
4	24362	7.2%
5	23652	7.0%

Value	Count	Frequency (%)
18	2166	0.6%
17	2040	0.6%
16	12046	3.6%
15	13419	4.0%
14	16199	4.8%

PayFukusyoPay2
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	413
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	362.8882844
Minimum	100
Maximum	14080
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	100
5-th percentile	110
Q1	150
median	210
Q3	370
95-th percentile	1100
Maximum	14080
Range	13980
Interquartile range (IQR)	220

Descriptive statistics

Standard deviation	495.5267378
Coefficient of variation (CV)	1.365507676
Kurtosis	83.60845008
Mean	362.8882844
Median Absolute Deviation (MAD)	80
Skewness	6.868840582
Sum	122871070
Variance	245546.7479
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
110	21375	6.3%
140	19404	5.7%
150	18534	5.5%
130	17917	5.3%
160	17167	5.1%
170	16298	4.8%
180	14299	4.2%
120	13016	3.8%
190	12865	3.8%
200	11164	3.3%
Other values (403)	176553	52.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
100	951	0.3%
110	21375	6.3%
120	13016	3.8%
130	17917	5.3%
140	19404	5.7%

Value	Count	Frequency (%)
14080	9	< 0.1%
11820	14	< 0.1%
10450	12	< 0.1%
10290	14	< 0.1%
8940	14	< 0.1%

PayFukusyoNinki2
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	18
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4.33293167
Minimum	1
Maximum	18
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	3
Q3	6
95-th percentile	11
Maximum	18
Range	17
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	3.182678145
Coefficient of variation (CV)	0.7345322723
Kurtosis	0.872067072
Mean	4.33293167
Median Absolute Deviation (MAD)	2
Skewness	1.14855457
Sum	1467096
Variance	10.12944018
Monotocity	Not monotonic

Histogram with fixed size bins (bins=18)

Value	Count	Frequency (%)
1	63584	18.8%
2	60491	17.9%
3	48375	14.3%
4	37968	11.2%
5	30472	9.0%
6	23683	7.0%
7	18685	5.5%
8	15062	4.4%
9	11753	3.5%
10	8655	2.6%
Other values (8)	19864	5.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	63584	18.8%
2	60491	17.9%
3	48375	14.3%
4	37968	11.2%
5	30472	9.0%

Value	Count	Frequency (%)
18	51	< 0.1%
17	187	0.1%
16	612	0.2%
15	1323	0.4%
14	2462	0.7%

PayFukusyoUmaban3
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	19
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	7.792360717
Minimum	0
Maximum	18
Zeros	1418
Zeros (%)	0.4%
Memory size	2.6 MiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	4
median	7
Q3	11
95-th percentile	15
Maximum	18
Range	18
Interquartile range (IQR)	7

Descriptive statistics

Standard deviation	4.507472884
Coefficient of variation (CV)	0.5784476679
Kurtosis	-1.014423756
Mean	7.792360717
Median Absolute Deviation (MAD)	4
Skewness	0.214404183
Sum	2638431
Variance	20.3173118
Monotocity	Not monotonic

Histogram with fixed size bins (bins=19)

Value	Count	Frequency (%)
3	24629	7.3%
2	24416	7.2%
6	24124	7.1%
1	23923	7.1%
4	23907	7.1%
5	23675	7.0%
8	23258	6.9%
7	23227	6.9%
10	22059	6.5%
9	21645	6.4%
Other values (9)	103729	30.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1418	0.4%
1	23923	7.1%
2	24416	7.2%
3	24629	7.3%
4	23907	7.1%

Value	Count	Frequency (%)
18	1994	0.6%
17	2458	0.7%
16	11477	3.4%
15	13978	4.1%
14	16156	4.8%

PayFukusyoPay3
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	483
Distinct (%)	0.1%
Missing	1418
Missing (%)	0.4%
Infinite	0
Infinite (%)	0.0%

Mean	443.4170191
Minimum	100
Maximum	16110
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	100
5-th percentile	120
Q1	170
median	250
Q3	460
95-th percentile	1410
Maximum	16110
Range	16010
Interquartile range (IQR)	290

Descriptive statistics

Standard deviation	613.856985
Coefficient of variation (CV)	1.384378494
Kurtosis	70.07135294
Mean	443.4170191
Median Absolute Deviation (MAD)	100
Skewness	6.191340491
Sum	149508690
Variance	376820.398
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
140	15326	4.5%
150	14732	4.4%
160	14292	4.2%
170	13900	4.1%
130	13100	3.9%
180	12999	3.8%
110	12449	3.7%
190	12256	3.6%
200	10739	3.2%
210	10102	3.0%
Other values (473)	207279	61.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
100	489	0.1%
110	12449	3.7%
120	10071	3.0%
130	13100	3.9%
140	15326	4.5%

Value	Count	Frequency (%)
16110	13	< 0.1%
14390	16	< 0.1%
11720	8	< 0.1%
11580	12	< 0.1%
10730	15	< 0.1%

PayFukusyoNinki3
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	18
Distinct (%)	< 0.1%
Missing	1418
Missing (%)	0.4%
Infinite	0
Infinite (%)	0.0%

Mean	5.11755948
Minimum	1
Maximum	18
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	4
Q3	7
95-th percentile	12
Maximum	18
Range	17
Interquartile range (IQR)	5

Descriptive statistics

Standard deviation	3.397833506
Coefficient of variation (CV)	0.6639558407
Kurtosis	0.2589021328
Mean	5.11755948
Median Absolute Deviation (MAD)	2
Skewness	0.8851947252
Sum	1725508
Variance	11.54527254
Monotocity	Not monotonic

Histogram with fixed size bins (bins=18)

Value	Count	Frequency (%)
2	45692	13.5%
3	44057	13.0%
1	43399	12.8%
4	39715	11.7%
5	34382	10.2%
6	29039	8.6%
7	24439	7.2%
8	19710	5.8%
9	16087	4.8%
10	12375	3.7%
Other values (8)	28279	8.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	43399	12.8%
2	45692	13.5%
3	44057	13.0%
4	39715	11.7%
5	34382	10.2%

Value	Count	Frequency (%)
18	157	< 0.1%
17	239	0.1%
16	1320	0.4%
15	2328	0.7%
14	3561	1.1%

PayFukusyoUmaban4
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	15
Distinct (%)	1.6%
Missing	337672
Missing (%)	99.7%
Infinite	0
Infinite (%)	0.0%

Mean	11.06521739
Minimum	3
Maximum	18
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	3
5-th percentile	5
Q1	8
median	11
Q3	14
95-th percentile	16
Maximum	18
Range	15
Interquartile range (IQR)	6

Descriptive statistics

Standard deviation	3.669728379
Coefficient of variation (CV)	0.3316453937
Kurtosis	-0.9756151074
Mean	11.06521739
Median Absolute Deviation (MAD)	3
Skewness	-0.181465139
Sum	10180
Variance	13.46690637
Monotocity	Not monotonic

Histogram with fixed size bins (bins=15)

Value	Count	Frequency (%)
15	116	< 0.1%
7	113	< 0.1%
14	113	< 0.1%
12	84	< 0.1%
8	73	< 0.1%
11	66	< 0.1%
13	64	< 0.1%
10	58	< 0.1%
9	58	< 0.1%
16	53	< 0.1%
Other values (5)	122	< 0.1%
(Missing)	337672	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
3	8	< 0.1%
4	25	< 0.1%
5	39	< 0.1%
6	21	< 0.1%
7	113	< 0.1%

Value	Count	Frequency (%)
18	29	< 0.1%
16	53	< 0.1%
15	116	< 0.1%
14	113	< 0.1%
13	64	< 0.1%

PayFukusyoPay4
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	39
Distinct (%)	4.2%
Missing	337672
Missing (%)	99.7%
Infinite	0
Infinite (%)	0.0%

Mean	411.1630435
Minimum	110
Maximum	2220
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	110
5-th percentile	110
Q1	140
median	260
Q3	470
95-th percentile	1600
Maximum	2220
Range	2110
Interquartile range (IQR)	330

Descriptive statistics

Standard deviation	431.5915022
Coefficient of variation (CV)	1.049684569
Kurtosis	5.758382805
Mean	411.1630435
Median Absolute Deviation (MAD)	130
Skewness	2.422839035
Sum	378270
Variance	186271.2247
Monotocity	Not monotonic

Histogram with fixed size bins (bins=39)

Value	Count	Frequency (%)
180	92	< 0.1%
110	82	< 0.1%
130	56	< 0.1%
140	54	< 0.1%
410	45	< 0.1%
120	44	< 0.1%
540	41	< 0.1%
290	37	< 0.1%
150	34	< 0.1%
240	27	< 0.1%
Other values (29)	408	0.1%
(Missing)	337672	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
110	82	< 0.1%
120	44	< 0.1%
130	56	< 0.1%
140	54	< 0.1%
150	34	< 0.1%

Value	Count	Frequency (%)
2220	15	< 0.1%
1750	16	< 0.1%
1600	18	< 0.1%
1460	15	< 0.1%
1380	8	< 0.1%

PayFukusyoNinki4
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	14
Distinct (%)	1.5%
Missing	337672
Missing (%)	99.7%
Infinite	0
Infinite (%)	0.0%

Mean	6.15
Minimum	1
Maximum	15
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	3
median	6
Q3	9
95-th percentile	13
Maximum	15
Range	14
Interquartile range (IQR)	6

Descriptive statistics

Standard deviation	3.729904444
Coefficient of variation (CV)	0.6064885274
Kurtosis	-1.030285916
Mean	6.15
Median Absolute Deviation (MAD)	3
Skewness	0.34859224
Sum	5658
Variance	13.91218716
Monotocity	Not monotonic

Histogram with fixed size bins (bins=14)

Value	Count	Frequency (%)
3	156	< 0.1%
10	98	< 0.1%
2	86	< 0.1%
9	85	< 0.1%
4	83	< 0.1%
1	82	< 0.1%
6	71	< 0.1%
8	60	< 0.1%
11	52	< 0.1%
5	43	< 0.1%
Other values (4)	104	< 0.1%
(Missing)	337672	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	82	< 0.1%
2	86	< 0.1%
3	156	< 0.1%
4	83	< 0.1%
5	43	< 0.1%

Value	Count	Frequency (%)
15	15	< 0.1%
13	33	< 0.1%
12	24	< 0.1%
11	52	< 0.1%
10	98	< 0.1%

PayFukusyoUmaban5
Categorical

HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	2
Distinct (%)	6.5%
Missing	338561
Missing (%)	> 99.9%
Memory size	2.6 MiB

11.0	18
14.0	13

Length

Max length	4
Median length	4
Mean length	4
Min length	4

Characters and Unicode

Total characters	124
Distinct characters	4
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	14.0
2nd row	14.0
3rd row	14.0
4th row	14.0
5th row	14.0

Value	Count	Frequency (%)
11.0	18	< 0.1%
14.0	13	< 0.1%
(Missing)	338561	> 99.9%

Histogram of lengths of the category

Value	Count	Frequency (%)
11.0	18	58.1%
14.0	13	41.9%

Most occurring characters

Value	Count	Frequency (%)
1	49	39.5%
.	31	25.0%
0	31	25.0%
4	13	10.5%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	93	75.0%
Other Punctuation	31	25.0%

Most frequent character per category

Value	Count	Frequency (%)
1	49	52.7%
0	31	33.3%
4	13	14.0%

Value	Count	Frequency (%)
.	31	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	124	100.0%

Most frequent character per script

Value	Count	Frequency (%)
1	49	39.5%
.	31	25.0%
0	31	25.0%
4	13	10.5%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	124	100.0%

Most frequent character per block

Value	Count	Frequency (%)
1	49	39.5%
.	31	25.0%
0	31	25.0%
4	13	10.5%

PayFukusyoNinki5
Categorical

HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	2
Distinct (%)	6.5%
Missing	338561
Missing (%)	> 99.9%
Memory size	2.6 MiB

2.0	18
1.0	13

Length

Max length	3
Median length	3
Mean length	3
Min length	3

Characters and Unicode

Total characters	93
Distinct characters	4
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1.0
2nd row	1.0
3rd row	1.0
4th row	1.0
5th row	1.0

Value	Count	Frequency (%)
2.0	18	< 0.1%
1.0	13	< 0.1%
(Missing)	338561	> 99.9%

Histogram of lengths of the category

Value	Count	Frequency (%)
2.0	18	58.1%
1.0	13	41.9%

Most occurring characters

Value	Count	Frequency (%)
.	31	33.3%
0	31	33.3%
2	18	19.4%
1	13	14.0%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	62	66.7%
Other Punctuation	31	33.3%

Most frequent character per category

Value	Count	Frequency (%)
0	31	50.0%
2	18	29.0%
1	13	21.0%

Value	Count	Frequency (%)
.	31	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	93	100.0%

Most frequent character per script

Value	Count	Frequency (%)
.	31	33.3%
0	31	33.3%
2	18	19.4%
1	13	14.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	93	100.0%

Most frequent character per block

Value	Count	Frequency (%)
.	31	33.3%
0	31	33.3%
2	18	19.4%
1	13	14.0%

PayWakurenKumi1
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	37
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	39.5166454
Minimum	0
Maximum	88
Zeros	4958
Zeros (%)	1.5%
Memory size	2.6 MiB

Quantile statistics

Minimum	0
5-th percentile	13
Q1	23
median	37
Q3	56
95-th percentile	78
Maximum	88
Range	88
Interquartile range (IQR)	33

Descriptive statistics

Standard deviation	20.48558546
Coefficient of variation (CV)	0.51840396
Kurtosis	-0.7857305299
Mean	39.5166454
Median Absolute Deviation (MAD)	18
Skewness	0.3596836582
Sum	13380020
Variance	419.6592118
Monotocity	Not monotonic

Histogram with fixed size bins (bins=37)

Value	Count	Frequency (%)
78	15974	4.7%
67	14273	4.2%
68	13834	4.1%
57	13686	4.0%
58	13497	4.0%
56	12890	3.8%
48	12186	3.6%
47	11662	3.4%
45	11496	3.4%
37	11220	3.3%
Other values (27)	207874	61.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4958	1.5%
11	1767	0.5%
12	9681	2.9%
13	9330	2.8%
14	9505	2.8%

Value	Count	Frequency (%)
88	4636	1.4%
78	15974	4.7%
77	3933	1.2%
68	13834	4.1%
67	14273	4.2%

PayWakurenPay1
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	1529
Distinct (%)	0.5%
Missing	4958
Missing (%)	1.5%
Infinite	0
Infinite (%)	0.0%

Mean	2145.96426
Minimum	120
Maximum	98640
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	120
5-th percentile	300
Q1	600
median	1110
Q3	2290
95-th percentile	7450
Maximum	98640
Range	98520
Interquartile range (IQR)	1690

Descriptive statistics

Standard deviation	3460.906262
Coefficient of variation (CV)	1.612751119
Kurtosis	116.0057631
Mean	2145.96426
Median Absolute Deviation (MAD)	630
Skewness	7.71790757
Sum	715966640
Variance	11977872.16
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
450	2590	0.8%
480	2559	0.8%
500	2555	0.8%
440	2539	0.7%
560	2528	0.7%
580	2500	0.7%
380	2492	0.7%
550	2451	0.7%
610	2445	0.7%
570	2441	0.7%
Other values (1519)	308534	91.1%
(Missing)	4958	1.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
120	24	< 0.1%
130	40	< 0.1%
140	55	< 0.1%
150	156	< 0.1%
160	245	0.1%

Value	Count	Frequency (%)
98640	14	< 0.1%
91210	15	< 0.1%
86110	13	< 0.1%
71830	14	< 0.1%
70970	14	< 0.1%

PayWakurenNinki1
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	36
Distinct (%)	< 0.1%
Missing	4958
Missing (%)	1.5%
Infinite	0
Infinite (%)	0.0%

Mean	6.922196179
Minimum	1
Maximum	36
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	5
Q3	10
95-th percentile	21
Maximum	36
Range	35
Interquartile range (IQR)	8

Descriptive statistics

Standard deviation	6.626961752
Coefficient of variation (CV)	0.9573496013
Kurtosis	1.877255488
Mean	6.922196179
Median Absolute Deviation (MAD)	3
Skewness	1.495687857
Sum	2309480
Variance	43.91662206
Monotocity	Not monotonic

Histogram with fixed size bins (bins=36)

Value	Count	Frequency (%)
1	64325	19.0%
2	42681	12.6%
3	33261	9.8%
4	25648	7.6%
5	21377	6.3%
6	18703	5.5%
7	16274	4.8%
8	13724	4.1%
9	11524	3.4%
10	9961	2.9%
Other values (26)	76156	22.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	64325	19.0%
2	42681	12.6%
3	33261	9.8%
4	25648	7.6%
5	21377	6.3%

Value	Count	Frequency (%)
36	31	< 0.1%
35	89	< 0.1%
34	157	< 0.1%
33	370	0.1%
32	556	0.2%

PayWakurenKumi2
Real number (ℝ_≥0)

MISSING

Distinct	23
Distinct (%)	3.7%
Missing	337965
Missing (%)	99.8%
Infinite	0
Infinite (%)	0.0%

Mean	48.33652313
Minimum	16
Maximum	78
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	16
5-th percentile	18
Q1	35
median	47
Q3	58
95-th percentile	78
Maximum	78
Range	62
Interquartile range (IQR)	23

Descriptive statistics

Standard deviation	17.80189142
Coefficient of variation (CV)	0.3682906892
Kurtosis	-0.8061137841
Mean	48.33652313
Median Absolute Deviation (MAD)	11
Skewness	0.08104622778
Sum	30307
Variance	316.9073381
Monotocity	Not monotonic

Histogram with fixed size bins (bins=23)

Value	Count	Frequency (%)
78	86	< 0.1%
46	76	< 0.1%
47	49	< 0.1%
55	37	< 0.1%
58	36	< 0.1%
37	32	< 0.1%
67	29	< 0.1%
34	29	< 0.1%
57	26	< 0.1%
56	26	< 0.1%
Other values (13)	201	0.1%
(Missing)	337965	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
16	17	< 0.1%
17	14	< 0.1%
18	12	< 0.1%
24	14	< 0.1%
26	26	< 0.1%

Value	Count	Frequency (%)
78	86	< 0.1%
68	21	< 0.1%
67	29	< 0.1%
58	36	< 0.1%
57	26	< 0.1%

PayWakurenPay2
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	42
Distinct (%)	6.7%
Missing	337965
Missing (%)	99.8%
Infinite	0
Infinite (%)	0.0%

Mean	994.9760766
Minimum	160
Maximum	4810
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	160
5-th percentile	200
Q1	320
median	560
Q3	1080
95-th percentile	3190
Maximum	4810
Range	4650
Interquartile range (IQR)	760

Descriptive statistics

Standard deviation	1032.469569
Coefficient of variation (CV)	1.037682808
Kurtosis	3.460746383
Mean	994.9760766
Median Absolute Deviation (MAD)	300
Skewness	1.961916789
Sum	623850
Variance	1065993.41
Monotocity	Not monotonic

Histogram with fixed size bins (bins=42)

Value	Count	Frequency (%)
320	57	< 0.1%
240	26	< 0.1%
370	26	< 0.1%
260	24	< 0.1%
430	24	< 0.1%
560	23	< 0.1%
1000	17	< 0.1%
360	16	< 0.1%
540	16	< 0.1%
2880	15	< 0.1%
Other values (32)	383	0.1%
(Missing)	337965	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
160	14	< 0.1%
190	12	< 0.1%
200	13	< 0.1%
240	26	< 0.1%
260	24	< 0.1%

Value	Count	Frequency (%)
4810	15	< 0.1%
3540	11	< 0.1%
3190	10	< 0.1%
3170	11	< 0.1%
3000	10	< 0.1%

PayWakurenNinki2
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	20
Distinct (%)	3.2%
Missing	337965
Missing (%)	99.8%
Infinite	0
Infinite (%)	0.0%

Mean	7.244019139
Minimum	1
Maximum	28
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	5
Q3	9
95-th percentile	24
Maximum	28
Range	27
Interquartile range (IQR)	7

Descriptive statistics

Standard deviation	6.964958512
Coefficient of variation (CV)	0.9614770998
Kurtosis	1.626971535
Mean	7.244019139
Median Absolute Deviation (MAD)	3
Skewness	1.529543177
Sum	4542
Variance	48.51064708
Monotocity	Not monotonic

Histogram with fixed size bins (bins=20)

Value	Count	Frequency (%)
1	95	< 0.1%
2	86	< 0.1%
3	81	< 0.1%
9	77	< 0.1%
4	50	< 0.1%
6	39	< 0.1%
8	25	< 0.1%
7	23	< 0.1%
5	20	< 0.1%
26	15	< 0.1%
Other values (10)	116	< 0.1%
(Missing)	337965	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	95	< 0.1%
2	86	< 0.1%
3	81	< 0.1%
4	50	< 0.1%
5	20	< 0.1%

Value	Count	Frequency (%)
28	15	< 0.1%
26	15	< 0.1%
24	10	< 0.1%
23	10	< 0.1%
20	11	< 0.1%

PayUmarenKumi1
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	153
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	549.9749994
Minimum	102
Maximum	1718
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	102
5-th percentile	106
Q1	214
median	507
Q3	811
95-th percentile	1215
Maximum	1718
Range	1616
Interquartile range (IQR)	597

Descriptive statistics

Standard deviation	358.6424735
Coefficient of variation (CV)	0.6521068666
Kurtosis	-0.3568882159
Mean	549.9749994
Median Absolute Deviation (MAD)	296
Skewness	0.6847124509
Sum	186217135
Variance	128624.4238
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
203	4381	1.3%
204	4275	1.3%
405	4220	1.2%
102	4151	1.2%
406	4082	1.2%
206	4064	1.2%
304	4045	1.2%
105	4032	1.2%
104	3990	1.2%
407	3943	1.2%
Other values (143)	297409	87.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
102	4151	1.2%
103	3864	1.1%
104	3990	1.2%
105	4032	1.2%
106	3424	1.0%

Value	Count	Frequency (%)
1718	325	0.1%
1618	246	0.1%
1617	223	0.1%
1518	368	0.1%
1517	207	0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	PayFukusyoPay1	PayFukusyoNinki1	PayFukusyoUmaban2	PayFukusyoPay2	PayFukusyoNinki2	PayFukusyoUmaban3	PayFukusyoPay3	PayFukusyoNinki3	PayFukusyoUmaban4	PayFukusyoPay4	PayFukusyoNinki4	PayFukusyoUmaban5	PayFukusyoNinki5	PayWakurenKumi1	PayWakurenPay1	PayWakurenNinki1	PayWakurenKumi2	PayWakurenPay2	PayWakurenNinki2	PayUmarenKumi1
0	270.00	5.00	15	160.00	1.00	5	190.00	2.00	nan	nan	nan	nan	nan	88	1,450.00	6.00	nan	nan	nan	1516
1	120.00	1.00	9	170.00	4.00	1	140.00	2.00	nan	nan	nan	nan	nan	56	690.00	2.00	nan	nan	nan	809
2	110.00	1.00	8	140.00	2.00	5	180.00	5.00	nan	nan	nan	nan	nan	48	310.00	1.00	nan	nan	nan	408
3	210.00	1.00	16	1,990.00	17.00	6	410.00	6.00	nan	nan	nan	nan	nan	78	970.00	2.00	nan	nan	nan	1516
4	270.00	5.00	15	160.00	1.00	5	190.00	2.00	nan	nan	nan	nan	nan	88	1,450.00	6.00	nan	nan	nan	1516
5	140.00	1.00	12	620.00	8.00	16	140.00	2.00	nan	nan	nan	nan	nan	56	1,350.00	6.00	nan	nan	nan	912
6	300.00	4.00	8	570.00	8.00	12	770.00	9.00	nan	nan	nan	nan	nan	15	2,430.00	11.00	nan	nan	nan	108
7	110.00	1.00	6	150.00	2.00	7	1,700.00	14.00	nan	nan	nan	nan	nan	38	320.00	1.00	nan	nan	nan	616
8	360.00	7.00	16	1,750.00	13.00	12	4,170.00	15.00	nan	nan	nan	nan	nan	78	5,940.00	17.00	nan	nan	nan	1416
9	110.00	1.00	8	210.00	3.00	11	240.00	4.00	nan	nan	nan	nan	nan	47	550.00	1.00	nan	nan	nan	814

Last rows

	PayFukusyoPay1	PayFukusyoNinki1	PayFukusyoUmaban2	PayFukusyoPay2	PayFukusyoNinki2	PayFukusyoUmaban3	PayFukusyoPay3	PayFukusyoNinki3	PayFukusyoUmaban4	PayFukusyoPay4	PayFukusyoNinki4	PayFukusyoUmaban5	PayFukusyoNinki5	PayWakurenKumi1	PayWakurenPay1	PayWakurenNinki1	PayWakurenKumi2	PayWakurenPay2	PayWakurenNinki2	PayUmarenKumi1
338582	110.00	1.00	5	120.00	2.00	8	350.00	5.00	nan	nan	nan	nan	nan	13	280.00	2.00	nan	nan	nan	205
338583	110.00	1.00	5	120.00	2.00	8	350.00	5.00	nan	nan	nan	nan	nan	13	280.00	2.00	nan	nan	nan	205
338584	340.00	4.00	13	340.00	5.00	1	180.00	2.00	nan	nan	nan	nan	nan	17	1,510.00	6.00	nan	nan	nan	213
338585	680.00	7.00	15	960.00	11.00	6	280.00	4.00	nan	nan	nan	nan	nan	47	1,350.00	5.00	nan	nan	nan	815
338586	180.00	3.00	2	160.00	1.00	12	250.00	5.00	nan	nan	nan	nan	nan	23	700.00	2.00	nan	nan	nan	204
338587	140.00	2.00	8	180.00	3.00	1	590.00	9.00	nan	nan	nan	nan	nan	78	490.00	3.00	nan	nan	nan	810
338588	180.00	3.00	6	190.00	4.00	2	150.00	1.00	nan	nan	nan	nan	nan	57	650.00	2.00	nan	nan	nan	610
338589	130.00	1.00	14	140.00	2.00	6	180.00	4.00	nan	nan	nan	nan	nan	47	530.00	1.00	nan	nan	nan	714
338590	220.00	2.00	9	540.00	7.00	4	910.00	11.00	nan	nan	nan	nan	nan	46	3,820.00	14.00	nan	nan	nan	509
338591	170.00	1.00	9	190.00	3.00	14	2,050.00	14.00	nan	nan	nan	nan	nan	55	1,190.00	4.00	nan	nan	nan	910

Overview

Variables

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows